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We propose a method to measure real- valued time series irreversibility which combines two differ- 
ent tools: the horizontal visibility algorithm and the KuUback-Leibler divergence. This method maps 
a time series to a directed network according to a geometric criterion. The degree of irreversibility of 
the series is then estimated by the KuUback-Leibler divergence (i.e. the distinguishability) between 
the in and out degree distributions of the associated graph. The method is computationally effi- 
cient, does not require any ad hoc symbolization process, and naturally takes into account multiple 
scales. We find that the method correctly distinguishes between reversible and irreversible station- 
ary time series, including analytical and numerical studies of its performance for: (i) reversible 
stochastic processes (uncorrelated and Gaussian linearly correlated), (ii) irreversible stochastic pro- 
cesses (a discrete flashing ratchet in an asymmetric potential), (iii) reversible (conservative) and 
irreversible (dissipative) chaotic maps, and (iv) dissipative chaotic maps in the presence of noise. 
Two alternative graph functionals, the degree and the degree-degree distributions, can be used as 
the KuUback-Leibler divergence argument. The former is simpler and more intuitive and can be used 
as a benchmark, but in the case of an irreversible process with null net current, the degree-degree 
distribution has to be considered to identifiy the irreversible nature of the series. 

PACS numbers: 05.45.Tp, 05.45.-a, 89.75.Hc 



I. INTRODUCTION 



A stationary process X{t) is said to be statistically time reversible (hereafter time reversible) if for every A'', the 
series {X{ti), ■ ■ ■ ,X{tN)} and {X(tAr), • • • ,X{ti)} have the same joint probability distributions [1]. Roughly, this 
means that a reversible time series and its time reversed are, statistically speaking, equally probable. Reversible 
processes include the family of Gaussian linear processes (as well as Fourier-transform surrogates and nonlinear static 
transformations of them) , and are associated with processes at thermal equilibrium in statistical physics. Conversely, 
time series irreversibility is indicative of the presence of nonlinearities in the underlying dynamics, including non- 
Gaussian stochastic processes and dissipative chaos, and are associated with systems driven out-of-equilibrium in the 
realm of thermodynamics [21 Ej. Time series irreversibility is an important topic in basic and applied science. From a 
physical perspective, and based on the relation between statistical reversibility and physical dissipation [51 13] , recent 
work uses the concept of time series irreversibility to derive information about the entropy production of the physical 
mechanism generating the series, even if one ignores any detail of such mechanism [11 [5]. In a more applied context, 
it has been suggested that irreversibility in complex physiological series decreases with aging or pathology, being 
maximal in young and healthy subjects [SHSji rendering this feature important for noninvasive diagnosis. As complex 
signals pervade natural and social sciences, the topic of time series reversibility is indeed relevant for scientists aiming 
to understand and model the dynamics behind complex signals. 

The definition of time series reversibility is formal and therefore there is not an a priori optimal algorithm to quantify 
it in practice. Recently, several methods to measure time irreversibility have been proposed [51 [71 [5HT5] . The majority 
of them perform a time series symbolization, typically making an empirical partition of the data range (note that 
such a transformation does not alter the reversible character of the output series lOj) and subsequently analyze the 
symbolized series, through statistical comparison of symbol strings occurrence in the forward and backwards series 
or using compression algorithms [51 1101 116] . The first step requires an extra amount of ad hoc information (such as 
range partitioning or size of the symbol alphabet) and therefore the output of these methods eventually depend on 
these extra parameters. A second issue is that since typical symbolization is local, the presence of multiple scales (a 
signature of complex signals) could be swept away by this coarse-graining: in this sense multi-scale algorithms have 
been proposed recently [3 [S] . 
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Motivated by these facts, here we explore the usefulness of the horizontal visibility algorithm in such context. This 
is a time series analysis method which was proposed recently [17] . It makes use of graph theoretical concepts, and it 
is based on the mapping of a time scries to a graph and the subsequent analysis of the associated graph properties 
[17H20j . Here we propose a time directed version of the horizontal visibility algorithm, and we show that it is a 
simple and well defined tool for measuring time series irreversibility. More precisely, we show that the KuUback- 
Leibler divergence [16] between the out and in degree distributions, D[Pout{k)\\Pin{k)], is a simple measure of the 
irreversibility of real-valued stationary stochastic series. Analytical and numerical results support our claims, and 
the presentation is as follows: The method is introduced in section II. In section III we analyze reversible time series 
generated from linear stochastic processes, which yield D[Pc,ut{k)\\Pin{k)] =0. As a further validation, in section IV 
we report the results obtained for irreversible series. We first analyze a thermodynamic system (a discrete fiashing 
ratchet) which shows time irreversibility when driven out of equilibrium. Its amount of irreversibility can be increased 
continuously tuning the value of a parameter of the system, and we find that the method can, not only distinguish, but 
also quantify the degree of irreversibility. We also study the effect of applying a stalling force in the opposite direction 
of the net current of particles in the ratchet. In this case the benchmark measure fails predicting reversibility whereas 
a generalized measure based on degree-degree distributions D[Pout{k, k')\\Pin(k, k')] goes beyond the phenomenon 
associated to physical currents and still detects irreversibility. We extend this analysis to chaotic signals, where our 
method distinguishes between dissipative and conservative chaos, and we analyze chaotic signals polluted with noise. 
Finally, a discussion is presented in section V. 

II. THE METHOD 
A. The horizontal visibility graph 

The family of visibility algorithms is a collection of methods that map series to networks according to specific 
geometric criteria [171 118j . The general purpose of such methods is to accurately map the information stored in a 
time series into an alternative mathematical structure, so that the powerful tools of graph theory may eventually 
be employed to characterize time series from a different viewpoint, bridging the gap between nonlinear time series 
analysis, dynamical systems, and graph theory [T^ [^T^El] . 

We focus here on a specific subclass called horizontal visibility algorithm, firstly proposed in p/7j, and defined as 
follows: Let {xt}t=i....,N be a real-valued time series of data. The algorithm assigns each datum of the series to a 
node in the horizontal visibility graph (HVg). Then, two nodes i and j in the graph are connected if one can draw a 
horizontal line in the time series joining Xi and Xj that does not intersect any intermediate data height (see figure [I]). 
Hence, i and j arc two connected nodes if the following geometrical criterion is fulfilled within the time series: 

Xi,Xj > Xn, \fn\i<n<j (1) 

Some results regarding the characterization of stochastic and chaotic series through this method have been put forward 
recently [171 120) , and the first steps for a mathematically sound characterization of horizontal visibility graphs have 
been established |25j . Interestingly, a very recent work suggests that the method can be used in practice to characterize 
not only time series but generic nonlinear discrete dynamical systems, sharing similarities with the theory of symbolic 
dynamics |21j . 

B. Directed HVg 

So far in the literature the family of visibility graphs are undirected, as visibility did not have a predefined temporal 
arrow. However, as already suggested in the seminal paper |18j . such a directionality can be made explicit by making 
use of directed networks or digraphs |26j . We address such directed version, defining a Directed Horizontal Visibility 
graph (DHVg) as a HVg, where the degree k{t) of the node t is now splitted in an ingoing degree kin{t), and an 
outgoing degree, such that k{t) = kin{t) + fcout(0- The ingoing degree k(t) is defined as the number of links of node t 
with other past nodes associated with data in the series (that is, nodes with t' < t). Conversely, the outgoing degree 
^out(^)j is defined as the number of links with future nodes. 

For a graphical illustration of the method, see figurefl] The degree distribution of a graph describes the probability 
of an arbitrary node to have degree k (i.e. k links) [2617 We define the in and out (or ingoing and outgoing) degree 
distributions of a DHVg as the probability distributions of /cout and fcjn of the graph which we call Pout(fc) = P{kout — 
k) and P\^{k) = P(A:i,i = k), respectively. 
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FIG. 1: Graphical illustration of the method. In the top we plot a sample time series {x{t)}. Each datum in the series is 
mapped to a node in the graph. Arrows, describing allowed directed visibility, link nodes. The associated directed horizontal 
visibility graph is plotted below. In this graph, each node has an ingoing degree fcin, which accounts for the number of links with 
past nodes, and an outgoing degree fcout, which in turn accounts for the number of links with future nodes. The asymmetry of 
the resulting graph can be captured in a first approximation through the invariance of the outgoing (or ingoing) degree series 
under time reversal. 



C. Quantifying irreversibility: DHVg and Kullback-Leibler divergence 

The main conjecture of this work is that the information stored in the in and out distributions take into account 
the amount of time irreversibility of the associated series. More precisely, we claim that this can be measured, in a 
first approximation, as the distance (in a distributional sense) between the in and out degree distributions (-Pin(fc) and 
Pout{k)). If needed, higher order measures can be used, such as the corresponding distance between the in and out 
degree-degree distributions {Pin{k, k') and Pout(fc, k')). These are defined as the in and out joint degree distributions 
of a node and its first neighbors 1261 , describing the probability of an arbitrary node whose neighbor has degree k' to 
have degree k. 

We make use of the Kullback-Leibler divergence [TC] as the distance between the in and out degree distributions. 
Relative entropy or Kullback-Leibler divergence (KLD) is introduced in information theory as a measure of distin- 
guishability between two probability distributions. Given a random variable x and two probability distributions p{x) 
and q{x), KLD between p and q is defined as follows: 



Z?(p||g)^^p(x)log^, (2) 
xex '^^^> 

which vanishes if and only if both probability distributions are equal p = q and it is bigger than zero otherwise. Unlike 
other measures used to estimate time irreversibility 6. .Qi IIOI I13| . the KLD is statistically significant, as it is proved 
by the Chernoff-Stein lemma: The probability of incorrectly guessing (via hypothesis testing) that a sequence of n 
data is distributed as p when the true distribution is q tends to e~"^^P"'^^ when n — >■ oo. The KLD is then related to 
the probability to fail when doing an hypothesis test, or equivalently, it is a measure of distinguishability: the more 
distinguishable are p and q with respect to each other, the larger is D{p\\q). 

In statistical mechanics, the KLD can be used to measure the time irreversibility of data produced by nonequilibrium 
processes but also to estimate the average entropy production of the physical process that generated the data [21 S] ■ 
Irreversibility can be assessed by the KLD between probability distributions associated to observables in the process 
and in its time reversal. These measure gives lower bounds to the entropy production, whose accuracy increases as 
the observables contain a more detailed description of the system. The measure that we present in this work has this 
limitation: it takes the information from the degree, which is a partial description of the process. Consequently, our 
technique does not give a tight bound to the entropy production. 
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Nevertheless, as we will show in several examples, the information of the outgoing degree distribution fcout is sufficient 
to distinguish between reversible and irreversible stochastic stationary series which are real- valued but discrete in time 
{xt}t=i,....N- We compare the outgoing degree distribution in the actual (forward) series -Pfc„„t (^l{2^(*)}t=i,...,Jv) — 
^out(fc) with the corresponding probability in the time-reversed (or backward) time series, which is equal to the 
probability distribution of the ingoing degree in the actual process Pk„^^ {k\{x{t)}t=N,...,i) — Pm{k). The KLD between 
these two distributions is 

D[P,^,{k)\\PUk)]^J2Pontik)\og^^. (3) 

This measure vanishes if and only if the outgoing and ingoing degree probability distributions of a time series are 
identical, Pout(fc) = ^in(^), and it is positive otherwise. We will apply it to several examples as a measure of 
irreversibility. 

Notice that previous methods to estimate time series irreversibility generally proceed by first making a (somewhat 
ad hoc) local symbolization of the series, coarse-graining each of the series data into a symbol (typically, an integer) 
from an ordered set. Then, they subsequently perform a statistical analysis of word occurrences (where a word of 
length n is simply a concatenation of n symbols) from the forward and backwards symbolized series [m [15] . Time 
series irreversibility is therefore linked to the difference between the word statistics of the forward and backwards 
symbolized series. The method presented here can also be considered as a symbolization if we restrict ourselves to the 
information stored in the series {fcout(i)}t=i....,Af and {fcin(0}t=i,. -,A'- However, at odds with other methods, here the 
symbolization process (i) lacks ad hoc parameters (such as number of symbols in the set or partition definition), and 
(ii) it takes into account global information: each coarse-graining xt — J> (fcin(t), kc,ut{t)) is performed using information 
from the whole series, according to the mapping criterion ([T]). Hence, this symbolization naturally takes into account 
multiple scales, which is desirable if we want to tackle complex signals [ZllSj- 

III. REVERSIBILITY 
A. Uncorrelated stochastic series 

For illustrative purposes, in figure [2] we have plotted the in and out degree distributions of the visibility graph 
associated to an uncorrelated random series {xt}t=i^...^N of size TV = 10^ : the distributions cannot be distinguished 
and KLD vanishes (the numerical value of KLD is shown in table |l]) which is indicative of a reversible series. In what 
follows we provide an exact derivation of the associated outgoing and ingoing degree distributions associated to this 
specific process, showing that they are indeed identical in the limit of infinite size series. 

Theorem 1. Let {xt}t=-oo,...,oo be a bi-infinite sequence of independent and identically distributed random variables 
extracted from a continuous probability density f{x). Then, both the in and out degree distributions of its associated 
directed horizontal visibility graph are 

Pin(fc) =Pout(fc) - ,fc-l,2,3,... (4) 

Proof (out-distribution). Let x be an arbitrary datum of the aforementioned series. The probability that the 
horizontal visibility of x is interrupted by a datum Xr on its right is independent of /(x). 



OO /"OO 



/ f{x)f{Xr)dXrdx^ I f {x)[l - F {x)]dx ^ 
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where F{x) = f{x')dx'. 

The probability P{k) of the datum x being capable of exactly seeing k data may be expressed as 

p(fc) = g(fc)$i = ig(fc), (5) 

where Q{k) is the probability of x seeing at least k data. Q{k) may be recurrently calculated via 

Q(fc) = Q(fc_l)(l_$l)^lQ(fc_l), (6) 
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FIG. 2: Top: A sample uncorrelated random time series extracted from a uniform distribution U[0, 1]. Bottom: The in and out 
degree distributions of the DHVg associated to the random series. The process is reversible and the graph degree distributions 
are, besides finite size effects, equivalent. The deviation is measured through their KLD (see table n|. 



from which, with Q{1) = 1, the following expression is obtained 



which together with equation ([5]) concludes the proof. An analogous derivation holds for the in case. 

Note that this result is independent of the underlying probability density /(x): it holds not only for Gaussian or 
uniformly distributed random series, but for any series of independent and identically distributed (i.i.d.) random 
variables extracted from a continuous distribution f{x). A trivial corollary of this theorem is that the KLD between 
the in and out degree distributions associated to a random uncorrelated process tends asymptotically to zero with 
the series size, which correctly suggests that the series is time reversible. 



In the last section we considered uncorrelated stochastic series which are our first example of a reversible series with 
D[Pout{k)\\Pin{k)] =0. As a further validation, here we focus on linearly correlated stochastic processes as additional 
examples of reversible dynamics [1 . We use the minimal suhstraction procedure |20j to generate such correlated 
series. This method is a modification of the standard Fourier filtering method, which consists in filtering a series 
of uncorrelated random numbers in Fourier space. We study time series whose correlation is exponentially decaying 
C{t) ~ exp(— t/r) (akin to an Ornstein-Uhlenbeck process) and power law decaying C{t) ^ t~'^ . In tablefflwe show 




(7) 
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FIG. 3: Log-log plot of D[Pout{k)\\Pin{k)] of the graph associated to an Ornstein-Uhlenbeck process as a function of the series 
size A*' (dots are the result of an ensemble average over several realizations). Note that KLD decreases with series size and 
tends to zero asymptotically. 

that the KLD of these series are all very close to zero, and its deviation from zero is originated by finite size effects, 
as it is shown in figure |3] 

IV. IRREVERSIBILITY 
A. Discrete flashing ratchet 




r 

OFF 

FIG. 4: Discrete flashing ratchet scheme. Particles are at temperature T moving in a periodic linear asymmetric potential of 
height 2V. The potential is switched on and off at a constant rate r, which originates a net current of particles to the left. If 
the potential is ON, the state of the potential is represented by its position x — {0, 1, 2}, and if it is OFF by a; + 3 = {3, 4, 5}. 

We now study a thermodynamic system which can be smoothly driven out of equilibrium by modifying the value of 



7 




V/kT 

FIG. 5: -D[Pout(fc)||Pin(fc)] and D[Po^t{k,k')\\Pi^{k,k')] for a discrete flashing ratchet (r = 1) as a function of V/kT. For each 
value of V we generate a stationary time series of TV = 10® steps described with full information (position and state of the 
potential). The system is in equilibrium for V = 0, and it is driven out of equilibrium for V > G. 

a physical parameter. We make use of the time series generated by a discrete flashing ratchet model introduced in 
The ratchet consists of a particle moving in a one dimensional lattice. The particle is at temperature T and moves in 
a periodic asymmetric potential of height 2V , which is switched on and off at a rate r (see Figure |4] for details). The 
switching rate is independent of the position of the particle, breaking detailed balance (HE). Hence, switching the 
potential drives the system out of equilibrium resulting in a directed motion or net current of particles. When using 
full information of the process, trajectories of the system are described by two variables: the position of the particle 
X = {0, 1, 2} and the state of the potential, y = {ON, OFF}. The time series are constructed from x and y variables 
as follows: {x, y) — x ii y = ON and [x. y) = a; + 3 if y = OFF. 

The dynamics of the system is described by a six-state Markov chain with transition probabilities Pi^j = 
ri_j. j / Ti-*. j , where ^i^j is the transition rate from i to j and the sum runs over the accessible states from i (see 
figure |4|. All transition rates satisfy the detailed balance condition with respect to the thermal bath at temperature T, 
except the switches between ON and OFF. When the potential is on, z, j = {0, 1, 2} and F^.^^ = exp[— (V^- — Vi)/kT]. 
When it is off, i,j = {3,4,5} and Ti^j ~ 1. On the other hand, switches are implemented with rates that do not 
depend on the position of the particle and therefore do not satisfy detail balance condition : Ti^i^-^ = Ti-^-^^i = r, 
for i = {0, 1, 2}. 

In Figure[5]we depict the values of £'[Fout(^)||-Pin(fc)] and I?[Pout(fc, k')\\Pin{k, k')] as a function of V/kT, for 6— state 
time series of 2^^ data. Note that for V — Q detailed balance condition is satisfied, the system is in equilibrium 
and trajectories are statistically reversible. In this case both KLD using degree distributions and degree-degree 
distributions vanish. On the other hand, if V is increased, the system is driven out of equilibrium, what introduces a 
net statistical irreversibility which increases with V ^ . The amount of irreversibility estimated with KLD increases 
with V for both measures, therefore the results produced by the method are qualitatively correct. Interestingly enough, 
the tendency holds even for high values of the potential, where the statistics are poor and the KLD of sequences of 
symbols usually fail when estimating irreversibility [4]. However the values of the KLD that we find are far below 
the KLD per step between the forward and backward trajectories, which is equal to the dissipation as reported in [3]. 
The degree distributions capture the irreversibility of the original series but it is difficult to establish a quantitative 
relationship between ([s]) and the KLD between trajectories. 

On the other hand, the measure based on the degree-degree distribution _D[Pout(fc, ^')ll^in(fci fc')] takes into account 
more information of the visibility graph structure than the KLD using degree distributions, providing a closer bound 
to the physical dissipation as it is expected by the chain rule ^6j, £'[Pout(fc, k')\\Pin{k, k')] > D[Pout{k)\\Pin{k)]- The 
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improvement is significant in some situations. Consider for instance the flashing ratchet with a force opposite to the 
net current on the system |4]. The current vanishes for a given value of the force usually termed as stalling force. 
When the force reaches this value, the system is still out of equilibrium {V > 0) and it is therefore time irreversible, 
but no current of particles is observed if we describe the dynamics of the ratchet with partial information given by 
the position x. 




0.01 0.02 0.03 0.04 

FL/kT 

FIG. 6: Irreversibility measures D[Pout{k)\\Pin(k)] and D[Pout{k, k')\\Pin{k, k')] in the flashing ratchet (r = 2, V = 2kT) as a 
function of FL/kT. Here, F is the applied force and L is the spatial period of the ratchet, which in this case is equal to 1. 
For each value of the force, we make use of a single stationary series of size A'' — 10® containing partial information (the state 
information is removed). 

In Fig. |6]we show how f [-Pout (fc)|| -Pin (^)] tends to zero when the force approaches to the stalling value. Therefore, 
our measure of irreversibility pi fails in this case, as do other KLD estimators based on local flows or currents [4]. 
However, D[Po^^t{k, k')\\Pi,-^{k,W)] captures the irreversibility of the time series, and yields a positive value at the 
stalling force. 

B. Chaotic series 

We have applied our method to several chaotic series and found that it is able to distinguish between dissipative 
and conservative chaotic systems. Dissipative chaotic systems are those that do not preserve the volume of the phase 
space, and they produce irreversible time series. This is the case of chaotic maps in which entropy production via 
instabilities in the forward time direction is quantitatively different to the amount of past information lost. In other 
words, those whose positive Lyapunov exponents, which characterize chaos in the forward process, differ in magnitude 
with negative ones, which characterize chaos in the backward process |10j . In this section we analyze several chaotic 
maps and estimate the degree of reversibility of their associated time series using our measure, showing that for 
dissipative chaotic series it is positive while it vanishes for an example of conservative chaos. 

1. The Logistic map at fi = A is irreversible: analytical derivations 

For illustrative purposes, in figure [7| we have plotted the in and out degree distributions of the DHVg associated 
to a paradigmatic dissipative chaotic system: the Logistic map at fi — 4. There is a clear distinction between both 
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FIG. 7: Top: A sample chaotic time series extracted from a fully chaotic Logistic map Xt+i = 4a;t(l — Xt). Bottom: The in 
and out degree distributions of the DHVg associated to the chaotic series. The process is irreversible and the graph degree 
distributions are clearly different. The deviation is measured through the KLD, which is positive in this case (see table 



distributions, as it is quantified by the KLD, which in this case is positive both for degree and degree-degree cases 
(see table |l]). Furthermore, in figure |8] we make a finite size analysis in this particular case, showing that our measure 
quickly converges to an asymptotic value which clearly deviates from zero, at odds with reversible processes. 

Recall that in section III we proved analytically that for a random uncorrelated process £'[Pout(fc)| l-Pin(^)] = 0, 
since Pin(fc) = Pout(fc)- Proving a similar result for a generic irreversible process is a major challenge, since finding 
out exact results for the entire degree distributions is in general difficult [20] • However, note that the KLD between 
two distributions is zero if and only if the distributions are the same in the entire support. Therefore, if we want to 
prove that this measure is strictly positive, it is sufficient to find that Pin(fc) 7^ Pout(fc) for some value of the degree k. 
Here we take advantage of this fact to provide a rather general recipe to prove that a chaotic system is irreversible. 

Consider a time series {xt\t=i,...,N with a joint probability distribution /(xi, X2, xjv) and support {a,b), and 
denote Xt-i, a;*, Xt+i three (ordered) generic data of the series. By construction, 



Pout(fc = l) = Pixt<xt+i)= / dxt / dxt+if{xt,xt+i), 

J a J Xt 

Pin{k = 1) = P{xt-1 >Xt) = l- Pout(fc = 1). 



(8) 



The probability that /cout — 1 (^in — 1) is actually the probability that the series increases (decreases) in one step. 
This probability is independent of time, because we consider stationary series. If the chaotic map is of the form 
Xt+i = F(xt), it is Markovian, and the preceding equations simplify: 



Pout(fc 



nb nb 

1) = / dxt / 

J a J x+ 



dxt+if{xt)f[xt+i\xt). 



(9) 



For chaotic dynamical systems whose trajectories are in the attractor, there exists an invariant probability measure 
that characterizes the long-term fraction of time spent by the system in the various regions of the attractor. In the 
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FIG. 8: Log-log plot of D[Pout{k)\\Pin{k)] of the graph associated to a fully chaotic Logistic map Xt+i — 4xt{l — Xt), as a 
function of the series size (dots are the result of an ensemble average over different realizations). Our irreversibility measure 
converges with series size to an asymptotical nonzero value. 



case of the Logistic map 

F{xt) = fixtil - Xt) (10) 
with parameter /i = 4, the attractor is the whole interval [0, 1] and the probability measure f{x) corresponds to 

1 



fix) 



(11) 



T:y^x{l — x) 

Now, for a deterministic system, the transition probability is simply 

fixt+i\xt) = S{xt+i-F{xt)), (12) 
where S{x) is the Dirac delta distribution. Equations ([9| for the Logistic map with /i = 4 and x G [0, 1] reads 

Pout{k = l)= f dxt f dxt+if{xt)S{xt+i-F{xt)). (13) 

Jo Jxt 

Notice that, using the properties of the Dirac delta distribution, J^^ 6{xt+i — F{xt))dxt+i is equal to one iff F(xt) e 
[x-t, 1], what happens iff < < 3/4, and it is zero otherwise. Therefore the only effect of this integral is to restrict 
the integration range of to be [0,3/4]. Equation (13) reduces to 



/•3/4 

Pontik = 1) = / dxtfixt) = 2/3, (14) 
Jo 

and Pin(fc = 1) = 1/3. We conclude that Pout(fc) 7^ Pin{k) for the Logistic map and hence the KLD measure based 
on degree distributions is positive. Recall that Pout(^ = 1) = 2/3 is the probability that the series exhibits a positive 
jump (xt > xt-i) once in the attractor. These positive jumps must be smaller in size than the negative jumps 
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Series description 


D[Pout(fc)llPin(fc)] 


D[Poutik,k')\\Pinik,k')] 


Reversible Stochastic Processes 






t/[0, 1] uiicorrelcited 


3.88 • lO"*" 


2.85 ■ 10"" 


Ornstein-Uhlenbeck (t = 1.0) 


7.82 • lO"** 


1.52 • 10"* 


Long-range correlated 






stationary process (7 = 2.0) 


1.28 • 10~^ 


2.0 • 10"* 


Dissipative Chaos 






Logistic map (/i = 4) 


0.377 


2.978 


a map (a — 3) 


0.455 


3.005 


/~u m cit~\ I /~v.' — A 1 
Lx. liidJJ I Lt — '-t J 


0.522 


tj.0±0 


Henon map (a = 1.4, b = 0.3) 


0.178 


1.707 


Lozi map 


0.114 


1.265 


Kaplan Yorke map 


0.164 


0.390 


Conservative Chaos 






Arnold Cat map 


1.77- 10"^ 


4.05 • 10"* 



TABLE I: Values of the irreversibility measure associated to the degree distribution -D[Pout(fe)|j-Pin(fc)] and the degree-degree 
distribution D [Pout (k, k')\\ Pin [k, k')] respectively, for the visibility graphs associated to series of 10*' data generated from 
reversible and irreversible processes. In every case chain rule is satisfied, since D[Pout{k,k')\\Pin{k,k')] > D[Pout{k)\\Pin{k)]. 
Note that that the method correctly distinguishes between reversible and irreversible processes, as KLD vanishes for the former 
and it is positive for the latter. 

because, once in the attractor, (xt) is constant. The irreversibility captured by the difference between Pout(fc = 1) 
and Pin{k = 1) is then the asymmetry of the probabihty distribution of the slope Xt — Xt-i of the original time series. 
The KLD of the degree distributions given by ([s]) clearly goes beyond this simple signature of irreversibility and can 
capture more complex and long-range traits. 

2. Other chaotic maps 

For completeness, we consider other examples of dissipative chaotic systems analyzed in |27| : 

1. The a-map: xt+i = 1 — |2a;f — 1|", which reduces to the Logistic and tent maps in their fully chaotic region for 
a = 2 and a — \ respectively. We analyze this map for a = 3, 4. 

2. The 2D Henon map: Xt+i = 1 + yt — ax^, yt+i = bxt, in the fully chaotic region (a = 1.4, b = 0.3). 

3. The Lozi map: a piecewise-linear variant of the Henon map given by Xt+i = ^ + Vn — o,\xt\, yt+i — bxt in the 
chaotic regime (a = 1.7 and b = 0.5). 

4. The Kaplan-Yorke map: Xt+i — 2xt mod(l),yt+i = Xyt + cos(47ra;t) mod(l). 

We generate stationary time series with these maps and take data once the system is in the corresponding attractor. 
In table |l] we show the value of the KLD between the in and out degree and degree-degree distributions for these 
series. In every case, we find an asymptotic positive value, in agreement with the conjecture that dissipative chaos is 
indeed time irreversible. 

Finally, we also consider the Arnold cat map: Xt+i — xt+yt niod(l), yt+i = Xt + 2yt mod(l). At odds with previous 
dissipative maps, this is an example of a conservative (measure-preserving) chaotic system with integer Kaplan-Yorke 
dimension [57]. The map has two Lyapunov exponents which coincide in mag nitude Ai = ln(3 + y/E)/2^ 0.9624 and 
A2 = ln(3 — y/5)/2 = —0.9624. This implies that the amount of information created in the forward process (Ai) is 
equal to the amount of information created in the backwards process (— A2), therefore the process is time reversible. 
In figure [9]we show that -D[Pout(fc)||Pin(fc)] for a time series of this map asymptotically tends to zero with series size, 
and the same happens with the degree-degree distributions (see table |l]). This correctly suggests that albeit chaotic, 
the map is statistically time reversible. 
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FIG. 9: Log-log plot of D[Pout{k)\\Pin{k)] of the graph associated to the Arnold cat map as a function of the series size A'^ 
(dots are the result of an ensemble average over different realizations). Note that the irreversibility measure decreases with 
series size, and asymptotically tends to zero, which suggests that this chaotic map is reversible. 



C. Irreversible chaotic series polluted with noise 



Standard time series analysis methods evidence problems when noise is present in chaotic series. Even a small 
amount of noise can destroy the fractal structure of a chaotic attractor and mislead the calculation of chaos indicators 
such as the correlation dimension or the Lyapunov exponents [28]. In order to check if our method is robust, we add 
an amount of white noise (measurement noise) to a signal extracted from a fully chaotic Logistic map (/i = 4.0). In 
figure 10 we plot D [Pout {k)\\ Pin (k)] of its associated visibility graph as a function of the noise amplitude (the value 
corresponding to a pure random signal is also plotted for comparison). The KLD of the signal polluted with noise is 
significantly greater than zero, as it exceeds the one associated to the noise in four orders of magnitude, even when the 
noise reaches the 100% of the signal amplitude. Therefore our method correctly predicts that the signal is irreversible 
even when adding noise. 



V. DISCUSSION 



In this paper we have introduced a new method to measure time irreversibility of real valued stationary stochastic 
time series. The algorithm proceeds by mapping the series into an alternative representation, the directed horizon- 
tal visibility graph. We have shown that the KuUback-Leibler divergence (KLD) between the in and out degree 
distributions calculated on this graph is a measure of the irreversibility of the series. 

We have shown that the difference between the in and out distributions at fc = 1 measures the asymmetry in the 
PDF of the slope of the series. The degree, however, contains information of long-range correlations and structures 
in the series. In particular, the degree-degree distribution can detect the irreversibility in a series with a symmetric 
slope, as we have shown for the flashing ratchet at stall force. 

Our technique discriminates between conservative and dissipative chaotic maps. The method has been validated 
by studying both reversible (uncorrelated and linearly correlated stochastic processes as well as conservative chaotic 
maps) and irreversible (out-of-equilibrium physical processes and dissipative chaotic maps) series. 

We have also shown that the method is robust against noise, in the sense that irreversible signals are well character- 
ized even when these signals are polluted with a significant amount of (reversible) noise. It is also worth emphasizing 
that it lacks a symbolization process, and hence it can be applied directly to any kind of real-valued time series. 
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FIG. 10: Semi-log plot of D [Pout (fc)|| Pin (fc)] of the graph associated to scries of 10*' data extracted from a fully chaotic Logistic 
map Xt+i = 4a;t(l — Xt) polluted with extrinsic white uniform noise C/[— 0.5, 0.5], as a function of the noise amplitude. The 
corresponding KLD value of a uniform series is plotted for comparison, which is five orders of magnitude smaller even when 
the chaotic signal is polluted with an amount of noise of the same amplitude. This suggests that our measure is robust against 
noise. 

This makes our technique of potential interest for several communities. This includes for instance biological sciences, 
where there is not such a simple tool to discriminate between time series generated by active (irreversible) and passive 
(reversible) processes. 
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